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I.  \  INTRODUCTION 

-Y  Q/ 

This  quarterly  status  report  contains  the  results  of  the  ^'Cost 

O' 

Estimation  Study,”  contract  N00014-85-C-Q892,  conducted  for  the  Naval  Center 
for  Cost  Analysis  (under  the  auspices  of  the  Office  of  Naval  Research)  during 
the  period  of  performance  12  January  1987  through  04  April  1987.  The  effort 
described  In  this  quarterly  status  report  focuses  upon  the  following  three 
areas  addressed  In  Task  III:  .  (The  statement  and  objectives  of  TASK  III  are 
given  In  Appendix  1.) 


(I)  The  collection  of  current  AVIONICS  data  and  subsequent 
derivation  of  preliminary  CER  (Cost  Estimating  Relationship) 
prototypes  for  ultimately  calibrating  the  SASET  model  parameters. 
This  Includes  the  generation  of  SASET  productivity  factors  and 
complexity  multipliers;  and  > 


(2)  The  categorization  and  organization  of  functional  sizing  data 
for  formulating  a  suitable  AVIONICS  data  base.  This  AVIONICS  data 
base  will  be  utilized  in  the  SASET  model  in  generating  cost  and 
schedule  outputs;  and 


(3)  The  calibration  of  Che  SASET  model  AVIONICS  data  base  to  ensure 
verification  and  validation  of  all  SASET  model  parameters.  In  this 
respect,  a  total  review  of  SASET  requirements  has  begun.  The  Intent 

/  V- 

is  to  update  the  "SASET  REQUIREMENTS”  document  within  the  next 
quarterly  reporting  period. 

In  addition,  substantive  effort  is  currently  being  devoted  to  the  computeri¬ 
zation  of  the  SASET  model  on  an  IBM  PC.  In  this  respect,  most  of  the  input 
screens  have  already  been  constructed,  the  data  base  for  Ground  Support 
software  has  been  Implemented,  and  some  of  the  output  Tables  and  Graphics  arc 
also  operational.  Preliminary  tests  are  also  being  conducted  to  integrate  all 
these  computer  modules.  Most  of  the  computer  computations  are  in  the  check 
out  phase,  and  considerable  effort  is  being  made  to  produce  a  "user  friendly", 
and  easily  understood  computer  package. 


II. 


APPLICABLE  REFERENCE  DOCUMENTS 


The  following  reference  documents  provide  the  essential  background 
for  subsequent  understanding  of  the  SASET  prototype  model: 

(1)  "Lessons  Learned  Report,"  Software  Cost  Estimation  Study,"  Naval 
Center  for  Cost  Analysis,  Contract  No.  N00014-85-C-0892,  Delivery 
Order  No.  MCR-86-508,  CDRL  Item  No.  A003,  April,  1986  (Martin 
Marietta  Publication  R-0420-86-1) . 

(2)  "Cost  Drivers  Report,"  Software  Cost  Estimation  Study,"  Naval 
Center  for  Cost  Analysis,  Contract  No.  NQ0014-85-C-0892,  Delivery 
Order  No.  MCR-86-509,  CDRL  Item  No.  A004,  June,  1986  (Martin  Marietta 
Publication  R-0420-86-2) . 

(3)  "CER  Methodology  Prototype  Report,"  Software  Cost  Estimation 
Study,"  Naval  Center  for  Cost  Analysis,  Contract  No. 

N00014-85-C-0892,  Delivery  Order  No.  MCR-86-510,  CDRL  Item  No.  A005, 
October,  1986  (Martin  Marietta  Publication  R-0420-86-6) . 


III.  RESULTS  OBTAINED 

The  essential  results  obtained  during  this  quarter  are  described  in 
detail,  and  fully  documented  in  the  "CER  (Cost  Estimating  Relationship)  MODEL 
PLANNING  REPORT,"  CDRL  Item  No.  A006  (Delivery  Order  No.  MCR-87-51J)  dated 
April,  1987  (Martin  Marietta  Corporation  Publication  R-0420-87-1) .  This 
report  discusses  the  derivation  of  Preliminary  CER  prototypes,  AVIONICS 
Functional  Sizing  Data  Base,  and  the  subsequent  calibration  of  the  AVIONICS 
data.  Also  Included  are  some  examples  of  calibration  data  in  tabular  form. 
These  data  are  being  used  to  validate  the  SASET  model  parameters,  and  to 
refine  some  of  the  functional  data  collected. 


3.1 


Preliminary  CER  Prototype  for  AVIONICS  DATA 


Table  3.-1  summarizes  some  of  the  basic  raw  data  collected 
in  deriving  preliminary  CER's  for  AVIONICS.  Basically,  the  data  are 
organized  by  type  of  software,  i.e..  Systems,  Applications,  and 
Support,  and  further  delineated  into  either  assembly  or  HOL  (Higher 
Order  Language).  In  addition,  these  data  pertain  to  the  Software 
Engineering  functions  only,  and  do  not  include  the  Systems 
Engineering  or  Test  organizations  and  their  related  activities. 

Also,  the  respective  life  cycle  phases  addressed  were  requirements, 
design,  code,  and  test.  (These  data  do  not  include  the  planning  or 
maintenance  phases.) 

Figure  3.-1. 1  illustrates  the  plot  of  these  seven  (7) 
AVIONICS  data  points  using  a  log-log  scale.  In  addition,  the  circled 
points  labeled  F-lll,  and  AWACS  represent  previous  programs  which 
were  similar  in  nature  to  the  current  data  obtained.  The  generic 
form  of  the  fitted  equation  is  a  straight  Line  given  by: 

log (HOURS)  -  log (CONSTANT)  +  (EXPONENT)log(HOL  EQ) . 

Obviously,  the  (EXPONENT)  represents  the  slope  of  the  line,  which  is 
also  the  productivity  factor.  For  this  sample  plot,  the  value 
obtained  is  approximately  3.9  Hours/LOC.  This  now  represents  a 
sample  value  for  use  in  the  SASET  model.  Also,  the  AVIONICS 
functions  associated  with  this  data  base  will  be  included  in  the 
SASET  model.  These  data  will  conform  to  the  indexing  system 
developed  in  the  following  section.  (Section  3.2,  Functional  Sizing 
of  AVIONICS  Data). 

It  is  anticipated  that  additional  effort  will  be  devoted  to 
refine  the  AVIONICS  data  base.  For  example,  the  LANTIRN  program 
contains  pertinent  cost,  sizing,  and  schedule  data  concerning  the 
individual  CPCI's  developed,  down  to  the  module  level. 
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Table  3.-1  Summary  of  AVIONICS  S/W  Programs 


PAE  (Precision  Attack  Enhancement) 

AVIONICS  Support  S/W 

17,000  HOL  Source  Lines  of  Code 

Language  -  Jovial.  New  HOL  equivalents:  17,000 

33,864  hours  for  S/W  Development 

Laser  Spot  Tracker  (on  board  F-18) 

AVIONICS  Applications  S/W 

9,082  Assembly  Language  Source  Lines  of  Code 
Language  -  Assembly.  New  HOL  equivalents,  2,331 
16,268  hours  for  S/W  Development 

TAD's  (Laser  System  on  Apache  Helicopter) 

AVIONICS  Applications  S/W 

21,000  Assembly  Language  Source  Lines  of  Code 
Language  -  Assembly.  New  HOL  equivalents:  6,167 
25,232  hours  for  S/W  Development. 

ASSAULT  BREAKER 
AVIONICS  Applications  S/W 

12.200  Assembly  Language  Source  Lines  of  Code 
Language  -  Assembly.  New  HOL  equivalents:  4,067 
15,438  hours  for  S/W  Development. 

Single  Seat  Aircraft  (night  attack  fighter) 
AVIONICS  Applications  S/W 

8,000  Assembly  Language  Source  Lines  of  Code 
Language  -  Assembly.  New  HOL  equivalents:  2,667 
10,641  hours  for  S/W  Development. 

Operational  Flight  Program  (close  air  support) 
AVIONICS  Applications  S/W 

14,100  Assembly  Language  Source  Lines  of  Code 
Language  -  Assembly.  New  HOL  equivalents:  4,700 
19,721  hours  for  S/W  Development. 

LANTIRN 

AVIONICS  Applications  S/W 

310,000  Source  Lines  of  Code  ( Asserably/Fo rtran) 
265,428  new  HOL  equivalents. 

614.200  hours  for  S/W  Development. 


3.2 


Functional  Sizing  of  AVIONICS  Data 


Table  3.-2  illustrates  the  overall  scheme  for  catagorizing 
software  functional  data.  This  specific  classification  hierarchy  was 
obtained  from  the  most  recent  (January,  1987)  ASPS  Cost  Reporting 
Document  (Section  VIII,  Software  Reporting  Requirements).  Although 
AVIONICS  is  delineated  as  a  special  category,  it  should  be  noted  that 
other  given  platforms,  such  as  jpace-borne  or  shipboard,  do  indeed 
have  similar  functions  described  by  index  elements  2.1  to  2.6.  Also, 
the  "Off-Line  Training"  (comprising  index  elements  15.1  to  15.4)  has 
been  reconfigured  into  two  (2)  Data  Reduction  items  (Category  A  and 
B)  to  reflect  activities  involving  moderate  and  extensive  processing 
requirements,  in  either  real-time  or  off-line  modes.  This  functional 
list  is  utilized  as  a  template  for  subsequently  structuring  the  SASET 
model  data  base.  In  some  instances  an  addititional  level  of  indexing 
was  used  to  describe  lower  level  functions.  For  example,  when 
representing  the  functional  activities  for  "Processing  Software" 
under  "Modeling",  the  SASET  data  base  hierarchy  will  index  to  two 
lower  levels,  i.e. ,  type  of  "modeling”  and  the  respective  parameters 
associated  with  the  "modeling"  functions.  Thus,  Rapid  Prototyping 
(type  of  modeling)  has  sub-categories  of  requirements,  design, 
graphics,  etc,  as  indenture  levels. 

Some  Normalized  Functional  Sizing  Statistics  for  AVIONICS 
are  shown  in  Table  3.-3.  These  data  were  originally  obtained  from 
ARINC  Research  Corporation,  technical  report  "Software  Sizing  and 
Cost  Estimation",  (July,  1985)  prepared  for  the  Office  of  the 
Controller  (NCDS),  Department  of  the  Navy,  Washington,  D.C.  under 
Contract  N00600-87-D-4Q45,  Delivery  Order  No.  0003,  CDRL  Item  No. 
A0002.  However,  these  respective  values  have  been  modified  using 
both  updated  data  and  the  algorithms  formulated  in  the  SASET  model  to 
reflect  nominal  baseline  numbers.  The  resultant  processed  values  are 
used  as  input  to  the  SASET  models.  The  SASET  modifications  reflect 
an  increase  of  approximately  73X.  This  factor  takes  into  account 
both  the  skewness  of  the  distribution  used  in  the  SASET  sizing 
algorithms,  and  the  range  of  three  (3)  sigma  values  covered  by  these 
functions . 


TABLE  3.-2 


Software  Functions 


Category 


Index 


Function 


Displays 


Avionics 

Command,  Control,  &  Communications 
Other 


Avionics 


i 

•* 


Command,  Control 
&  Communication 


Executive 


Data  Base 


Training 


Mission  Planning 
Navigation 

Aircraft  Steering  Flight  Control 

Sighting,  Designation  &  Location  Determination 

Weapon  Delivery 

Electronic  Countermeasures 

Other 

Network  Monitoring 
Network  Control  &  Switching 
Sensor  Control 
Signal  Processing 
Message  Processing 
Message  Distribution 
Message  Logging  &  Retrieval 
Data  Reduction 
Other 

Computer  Resource  Management 
Computer  Operator  Interface 
Other  Terminal  Operator  Interface 
Special  Device  Interface 
Other  Input  or  Output 

Error  Handling/Reconf iguration/Recovery 
Multicomputer  Configuration  Control 
Performance  Monitoring  &  Data  Collection 
Other 

On-line  Data  Base  Retrieval  &  Output 
On-line  Data  Base  Initialization  &  Updating 
Other 

Control  of  Exercise  Sequencing 
Operator  Performance  Data  Collection 
Other 


On-Line  Equipment 
Diagnost ic 


System  Readiness  Test 

Computer  Diagnostic 

Memory  Diagnostic 

Display  Diagnostic 

Switch/Indication  Panel  Diagnostic 

I/O  Diagnostic 

Mod  Diagnostic 

Other 


1 


TABLE  3.-2 


Software  Functions  (continued) 


Category 

Index 

Function 

Operating  System 

8.1 

Computer  Resource  Management 

8.2 

Computer  Operator  Interface 

8.3 

Terminal  Operator  Interface 

8.4 

Input  or  Output 

8.5 

Error  Handling/Reconf iguration/Recovery 

8.6 

Performance  Monitoring  &  Data  Collection 

8.7 

Other 

Equipment 

9.1 

Off-Line  Computer  Diagnostics 

Maintenance 

9.2 

Other 

Software 

10.1 

Higher-Order  Language  Compiler 

10.2 

Assembler 

10.3 

Debugger 

10.4 

Loader  or  Editor 

10.5 

Other 

Off-Line  Data  Base 

11.1 

Data  Base  Definition 

Management 

11.2 

Data  Base  Initialization  &  Updating 

11.3 

Data  Base  Retrieval  &  Output  Formatting 

11.4 

Data  Base  Restructuring 

11.5 

Off-Line  Data  Base 

11.6 

Other 

Design 

12.1 

Data  Base  Design 

12.2 

Data  Base  Processor  Design 

12.3 

Performance  Simulation 

12.4 

Data  Reduction 

12.5 

Data  Analysis 

12.6 

Other 

Test  Softwaie 

13.1 

Test  Case  Generation 

13.2 

Test  Case  Data  Recording 

13.3 

Test  Data  Reduction 

13.4 

Test  Analysis 

13.5 

Other 

Utilities 

14.1 

Media  Conversions 

14.2 

Format  Translation 

14.3 

Sort/Me rge 

14.4 

Program  Library  Maintenance 

14.5 

Other 

-8- 
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Catego 


n 


Off-Line  Training 


Project  Management 


Hardware  Subsystem 
Simulations 


TABLE  3.-2 


Software  Functions  (continued) 


Index 

Function 

15.1 

Data  Reduction,  Category  A 

15.2 

Data  Reduction,  Category  B 

15.3 

Scenario  Preparation 

15.4 

Other 

16.1 

Project  Event  Statue  Account 

16.2 

Schedule  Maintenance/Projection 

16.3 

Financial  Accounting 

16.4 

Software  Cost  Reporting 

16.5 

Hardware  Cost  Reporting 

16.6 

Software  Cost  Prediction 

16.7 

Hardware  Cost  Prediction 

16.8 

Other 

17.1 

Interfacing  Hardware  Simulations 

17.2 

Environmental  Simulators 

17.3 

Operator  Action  Simulations 

17.4 

Other 

V  ' 
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TABLE  3.-3 


NORMALIZED  FUNCTIONAL  SIZING  STATISTICS  FOR  AVIONICS 


Tuuction 

Index 

ARINC 

Average 

Size 

(LOC)* 

SASET 

Average 

Size 

(LOC)* 

1.1 

633 

1096 

1.2 

2888 

5000 

i .  3 

4199 

7273 

2.2 

1376 

2383 

2.4 

2106 

3648 

2.5 

9000 

15590 

2.6 

7057 

12223 

2.7 

3567 

6178 

3.1 

7164 

12400 

3.2 

4296 

7440 

3.2 

5661 

9800 

3.4 

2741 

4747 

3.5 

8220 

14237 

3.6 

1211 

2100 

3.9 

1232 

2100 

4.1 

4129 

7150 

4.2 

6212 

10760 

4.3 

12501 

21650 

4.4 

2512 

4350 

4.5 

560 

970 

4.8 

3434 

5950 

5.1 

5172 

10600 

5.2 

1314 

2275 

5.3 

9021 

15625 

7.1 

898 

1555 

10.3 

795 

1375 

13.1 

3935 

6815 

13.4 

10963 

18988 

17.1 

229 

400 

17.2 

9000 

15588 

*  LINES  OF  CODE  (HOL  equivalent) 
Less  Comments 


3.3  Calibration  of  AVIONICS  Data 


Figures  3.-1  through  3.-12  illustrate  typical  calibration  curves 
obtained  using  the  mix  complexity  and  project  complexity  parameters 
defined  in  reference  (2)  "Cost  Drivers  Report."  The  respective 
curves  are  based  upon  AVIONICS  data  from  over  150  real  world  software 
development  projects.  The  equation  plotted  has  the  following  generic 
form: 

Cl  C2 

(Productivity)  •  (Factor)  (Conversion)  (Mix)  (Prog) 

The  four  (4)  plots  shown  for  each  type  of  software  (Systems, 
Application,  Support)  illustrate  the  sensitivity  obtained  when  each 
of  the  four  (4)  variables  in  the  above  equation  (Factor,  Mix, 
Conversion,  and  Program)  are  treated  as  "independent  variables."  As 
can  be  observed  from  the  curves,  these  data  are  well  within  the  range 
of  the  productivity  factor  derived  from  the  CER  given  in  Figure 
3.-1. 1.  Furthermore,  the  overall  variation  of  complexity  factors 
defined  can  be  utilized  to  obtain  fine  gradations  of  productivity 
factors  within  each  type  of  software.  Thus,  SASET  can  be  validated 
using  the  table  look-ups  from  which  the  plots  were  originally 
derived.  (Some  sample  tabular  data  are  given  in  detail  in  the  "CER 
MODEL  PLANNING  .IEP0RT",  CDRL  Item  No.  A006,  Delivery  Order  No. 
MCR-87-511,  April,  1987.) 
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Figure  3.-3  plot  or  productivity  <h«s/loc)  vs.  HOL/ASSM  (MC-4.5.  PC*200-«50) 
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(  BOTH  X  ANO  V  COORDINATES  ARE  PLOTTED  ON  LINEAR  SCALES 
INDEPENDENT  VARIABLE-MIX  COMPLEXITY 
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figure  3.-6  PLOT  OF  PRODUCTIVITY  (HRS/LOC )  VS.  PROGRAM  COMPLEXITY  (MC*t  TO  10 > 
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IV. 


CONTRACT  EXPENDITURES 


The  total  amount  of  funds  (dollars)  expended  for  the  performance 
period  2  January  1986  through  4  April  1987  are  approximately  $235,300 
(including  fee). 

The  revised  schedule  for  the  CDRL  item  deli/trables  A006,  A007,  A008, 
and  A009  are  shown  in  Appendix  II.  The  Modification  Request  for  this  effort 
is  documented  In  Appendix  III. 


Respectfully  submitted. 


t—  // ",  dg  (t  -V 
Dr.  Aaron  N.  Silver 
Program  Manager 

MARTIN  MARIETTA  CORPORATION 
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APPENDIX  III. 


MARTIN  MARIETTA  DENVER  AEROSPACE 


POST  Office  BOX  IT* 
OCHVEP  COlOftAOO  MOt 
TtlCPMONC  IJ09IWM00O 


16  February  1987 

Refer  Co:  TEO-87-0085 


To: 

Air  Force  Plant  Representatives  Office 

Martin  Marietta  Denver  Aerospace 

P.0.  Box  179,  Mail  Stop  A-18 

Denver,  CO  80201-0179 

Attn: 

Cape 

.  Joe  M.  Williams  (RNA) 

Subj : 

Contract  N00014-85-C-0892 ;  Request  for  Modification 

Ref: 

(a) 

Martin  Marietta  Letter  TEO-86-0729  dated  24  November  1986; 
Subject:  Notice  of  stop  in  work  due  to  non-receipt  of 

FT '87  funds 

(b) 

Modification  No.  P00003  dated  8  January  1987  and  received 
14  January  1987 

Enel : 

(D 

Revised  Program  Master  Schedule 

1.  Narcin  MarietCa  requests  a  no-'coat,  five  (5)  veek  extension  to  the  current 
period  of  performance  for  the  technical  effort,  from  9  December  1985 
through  30  June  1988,  to  9  December  1985  through  5  Auguet  1988. 

2.  Thia  requeat  ia  a  reault  of  a  atop  in  work  during  the  period  between 

23  November  1986  and  12  January  1987  due  to  exhaustion  of  contract  funds 
as  documented  by  References  (a)  and  (b). 

3.  In  addition,  in  an  effort  to  reapread  contract  effort  an  re  evenly,  it  is 
requested  that  the  submittal  dates  for  several  icems  contained  in  the 
Contract  Data  Requirements  List  be  changed  as  follows: 


Sequence 

Block  12 

Block  12 

Number 

Currently 

Proposed  Revision 

A006 

14  months  after 
contract  award 

16  months  after 
contract  award 

A007 

15  months  after 
contract  award 

20  months  after 
contract  award 

A008 

16  months  after 
contract  sward 

24  months  after 
contract  award 

A009 

20  months  after 
contract  award 

32  months  after 
contract  award 

The  above  proposed  revision  dates  were  co-ordinated  with  Hr.  Brian  Flynn 
(ONR)  by  Dr.  Aaron  Silver  (Martin  Marietta)  during  Mr.  Flynn’s  last  visit 
at  the  Denver  facility. 
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4.  Enclosure  (1)  details  Che  revised  Prograa  Msscer  Schedule  incorporating 
all  of  the  above  changes. 

5.  Questions  concerning  this  eransaittal  should  be  directed  to  Cyndi  McKay  at 
(303)  971-9180. 

Very  truly  yours, 

MARTIN  MARIETTA  CORPORATION 


DLL/CLH/do 

cc:  ONR,  D.  Perdue,  1313A:DHP 


